Reading from the top down, the 
first four illustrations at the left 
show how music symbols are 
constructed from a small num- 
ber of lines to minimize flicker 
on a refreshing display. Because 
the coordinates are in hun- 
dredths of inches, the note 
heads of quarter, eighth, and 
sixteenth notes appear to be 
filled in when drawn to scale. 

The last illustration shows the 
beam for a grouping of eighth 
notes anchored at one end to 
the top of a stem 0.3 inches in 
length on the highest note in the 
group. The slope of the beam- is 
obtained from the vertical posi- 
tions of the first and last notes 
of the group. The stems of the 
remaining notes are drawn to 
meet the beam as shown. 

One product of a university project 
combining a computer and peripherals 
with an organ keyboard is 
the output of musical notation 


Capture and Display 


For more than a century various at- 
tempts have been made to obtain a 
written record of music as it is played 
at the keyboard. This problem has 
proven to be so difficult that the vari- 
ous inventors have chosen to dispense 
with traditional music notation and to 
produce a simplified graphical record. 
Attempts to produce music notation 
mechanically have been generally un- 
successful. Even today, music is 
printed by offset photolithography, 
with the master copy prepared by 
hand. 

As part of an on-going research 
project at the Univ. of Utah, a music 
system has been developed which 
brings together a dec pdp-8 computer, 
a ctc Datapoint 3300 terminal, a 
Tektronix 61 1 display, and a Schober 
electronic organ. As shown in Fig. 1 
(photo at far right), the organ, display, 
and terminal are arranged to permit 
convenient interaction between the user 
and the system. Fig. 2 (page 58) illus- 
trates information flow through the 
system — from printed score via a music 
description language through a termi- 
nal, or from keyboard activity, to 
printed score via the Tektronix display 
or hard copy plotter, or to an actual 
performance of the music via the or- 
gan tone generators. Within the com- 
puter various transformations upon 
the music are possible, including key 
transposition and tempo modification. 

In seeking to advance the techniques 
of keyboard recording originally put 
forth by the developers of the player 
piano, an isomorphic internal com- 
puter representation of the paper roll 


was developed. Fig. 3 (page 58) illus- 
trates a simplified fragment of a piano 
roll placed in a coordinate system. The 
times are arranged such that t„<t n+1 . 
The frequencies or pitches are arranged 
such that f„<f n+1 . 

In order to obtain this information 
with the computer, two useful items 
are continuously available: (1) time, 
and (2) the state of the keyboard. The 
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state of the keyboard is a sequence of 
bits, in which 1 indicates that a key is 
currently depressed, and 0 indicates 
that a key is currently not depressed. 
In order to determine when a change 
takes place, the keyboard is sampled 
to determine its current state. The 
exclusive-or of this state with the 
previous state is performed. If the re- 
sult is non-zero, the non-zero bits indi- 


cate which keys have changed. When a 
change has been detected, it is added to 
an event table, preceded by how much 
time had elapsed since the last event 
had taken place. A typical event table 
is shown in Fig. 4 (page 58). In order to 
conserve computer resources, the key- 
board is sampled at discrete time inter- 
vals. From practical experience, 20 
samplings per second suffice to capture 


even very complex keyboard activity. 
This can be verified by closely examin- 
ing a typical piano roll, which consists, 
not of continuous slits, but rather of 
rows of perforations, which serve the 
additional function of keeping the roll 
intact horizontally. Each small, per- 
forated hole can be thought of as a 
“clock tick” for the key it controls. 
Thus, the rate of the holes past the 
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player piano’s “read head” represents 
the rate of the “clock.” From many 
observations of player-piano rolls, the 
rate of 20 ticks per second is a reason- 
able estimate. Nuances of phrasing, for 
example, in which progression to the 
next note implies retarded release of 
the previous note, can be visually ob- 
served on piano rolls, in which two 
adjacent rows of perforations slightly 
overlap. In spite of the preference for 
this sampling rate, it is possible to sam- 
ple at lesser and greater rates by vary- 
ing the speed of the clock. 

To illustrate an application of the 
event table. Fig. 5 represents the event 
table which would result from the key- 
board activity represented in Fig. 3. 


The symbolism “+f„” represents the 
depression of the key which has fre- 
quency f n . Similarly, the symbolism 

f„” represents the release of the key 
which has frequency f„. Regarding 
Fig. 3 as the keyboard activity for one 
measure, the transformation of the re- 
sulting event table of Fig. 5 into tradi- 
tional music notation will be consid- 
ered. • 

In order to determine the point in a 
measure when a note of pitch f n be- 
gins, all the At’s in the event table 
which precede “+f n ” are added. In 
order to determine the duration of a 
note of pitch f n , all the At’s in the 
event table between “+f n ” and f 0 ” 
are added. From this formalism, f x 
begins at time 5+5=10, having dura- 
tion 5+15+5+5=30; f 2 begins at time 
5+5+5=15, having duration 15+5 
=20; and f 3 begins at time 5=5, having 
duration 5+5+15=25. These calcula- 
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tions can be verified graphically from 
Fig. 3. 

For the purposes of this example, 
each note shall be considered a sepa- 
rate and independent voice, which 
means that the rests for each note will 
be individually indicated. In addition, 
it shall be assumed that f, corresponds 
to D below middle C, that f 2 corre- 
sponds to G above middle C, and that 
f ;t corresponds to D above middle C 
plus one octave. Finally, it shall be 
assumed that 5 units of time corre- 
spond to a sixteenth note. This implies 
that 10 units, 20 units, 40 units, and 80 
units of time correspond respectively 
to eighth, quarter, half, and whole 
notes. A graphical representation of 
these time value assignments is shown 
in Fig. 6. Fig. 6 illustrates that precise 
timings are not required to obtain the 
desired note value. The principle is to 
define all the discrete note values for 
intended use along with their related 
“ideal” time value assignments. Sub- 
sequent to this definitional procedure, 
the requirement for obtaining note N n 
which corresponds to the ideal time, 

At, 

E, 

At., 

E., 


Fig. 4. A typical event table. 

to = 5 

+ 1*3 

At! = (t 2 -t,) = 5 

+ fi 

At., = (t,-t,) = 5 

+ f 2 

At, = (t 4 — 1 3 ) = 15 
-fa 

At, = (t,.-t 4 ) = 5 

-f., 

At r> = (t, -t r> ) = 5 
-fi 

Fig. 5. Event table from Fig. 3. 

T n , is to produce a note duration, D, 
which satisfies 

(T„-T n .!)/2<D<(T„ + -T n )/2, 
T„>T n .! 

Compare this to Fig. 6. Clearly, the 
fewer the number of discrete time 
values, the greater the reliability in 
achieving the desired note symbols in- 
teractively from the organ keyboard. 
An additional refinement to this note 
assignment technique involves con- 
tinual redefinition of ideal time values 
for note symbols. For example, when 
note N 3 is satisfied for durations D, 
through Dj (i<j), the ideal time, T :i , is 
redefined to be the average of D, 
through Dj. Subsequently, when N 3 is 
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satisfied for duration D jt „ T 3 is re- 
defined to be the average of D i+1 
through D j+I . Using this approach, the 
system is made to adapt to slight 
changes in tempo. 

Going back to the example of Fig. 3 
and applying the table of Fig. 6 to the 
results of the calculations on Fig. 5, it 
follows that the time preceding f, cor- 
responds to an eighth rest; the time 
preceding f„ corresponds to an eighth 
rest plus a sixteenth rest; and the time 
preceding f a corresponds to a sixteenth 
rest. The time duration of fj corre- 
sponds to a quarter note plus an eighth 
note, or a dotted quarter note; the time 
duration of L corresponds to a quarter 
note; and the time duration of f 3 cor- 
responds to a quarter note plus a six- 
teenth not,e. Assuming a time signature 
of 2/4, two quarter notes per measure, 
the time subsequent to f, is zero; the 
time subsequent to f 2 corresponds to a 
sixteenth rest; and the time subsequent 
to f, corresponds to an eighth rest. 
Gathering all this information to- 
gether, the measure of music notation 
obtained is shown in Fig. 7. 


The display of keyboard music 

By the time printing technology had 
advanced the state of the art of music 
printing and engraving to a point of 
perfection, the desire began to increase 
for a means of obtaining musical text 
of high quality more rapidly. Com- 
posers desiring such a facility recog- 
nized the advantages of ( 1 ) being able 
to express their musical ideas in nota- 
tion more rapidly, (2) being able to 
immediately interact with their ideas 
once expressed in notation, and (3) 
being able to provide high enough 
quality manuscript for immediate re- 
production by means of photolithog- 
raphy. 

At the Univ. of Utah, three mecha- 
nisms for displaying keyboard activity 


have been developed. The first mech- 
anism, shown in Fig. 8, represents 
keyboard activity as a series of hori- 
zontal lines emanating from the right 
edge of the graphic display. Vertical 
position is based on pitch, and horizon- 
tal length of line segments indicates 
note time durations. The moving result 
is analogous to a player-piano roll 
moving horizontally. The second 
mechanism, shown in Fig. 9, repre- 
sents the state of the organ keyboard at 
any moment on the musical staff in the 
key of C. The solid lines represent the 
musical staves, and the dashed lines 
represent ledger lines. Squares corre- 
spond to naturals or white keys, and 
diamonds correspond to sharps or black 
keys. The third mechanism, shown in 
Fig. 10 (page 60), is computer-gener- 
ated music notation of “Praeludium 
II” in C minor from The Well Tem- 
pered-Clavier, Book l of Johann Sebas- 
tian Bach. Fig. 11* (page 60) gives the 
original sheet music, and Fig. 12 (page 
60) illustrates the internal symbolic 
representation of the score, as entered 
into the computer through a terminal, 
or as obtained from an analysis of a 
keyboard performance of the score. 

Conclusions 

It has been shown that an interactive 
keyboard music system using an elec- 
tronic organ, computer, and display 
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can be realized. In the future, such a 
system might assist composers in the 
same way that typewriters assist writers 
today. Experience indicates that com- 
puter preparation of sheet music can 
provide significant cost savings to the 
music publishing industry. In addition, 
individual copies can be obtained from 
the Tektronix display for less than 8c ! 
each. 
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:2:SA4F%EFCFEFAFEFCFEF;SC3AGAFAGACAGAFAGA/ 


3 :S% B4FEFDFEFBFEFDFEF;SC3 AG AFAG ACAG AFAG A/ 
4:SC5G4FGEGFGC5G4FGEGFG;SC3EDEGEDECEDEGEDE/ 
5.SE5A4GAEAGAE5A4GAEAGA; SC3C4B3C4A3C4B3C4C3C4B3C4A3C4B3C4/ 
6:SD5#F4% EFDFEFD5F4EFDFEF;SC3% AGA#FAGACAGAFAGA/ 
7:SD5G4#FGD5G4FGDGFG;SB2B3 % ABGBABB2B3ABGBAB/ 

8:SC5 % E4DECEDEC5E4DECEDE;SB2G3FG% EGFGB2G3FGEGFG/ 


Information enclosed in colons is treated as commentary and ignored by the system. 
“K3!” denotes that the key signature has three fiats. “$4-4” indicates a time signature of 
4/4. “:1:” is commentary that measure number 1 is about to be encoded. “SC5” means 
a sixteenth note of C in the fifth octave, where C in the fourth octave is middle C. “E4” 
means a sixteenth note (by default) of E in the fourth ocave. Subsequent letters denote 
subsequent sixteenth notes in the fourth octave by default. Thus, octave and time designa- 
tors remain in effect until respecified. The semicolon starts the first measure over again 
for another voice, and the slash defines the end of the measure. In the second measure, 
“%E” specifies E natural, since in a key signature of three flats E is normally flat. Simi- 
larly, “#F” in the sixth measure denotes F sharp. Like time and octave designators, 
accidentals remain in effect until respecified, or until the beginning of the next measure, 
in which case the accidentals specified in the key signature go back into effect. 

Fig. 12 
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